All scale-free networks are sparse 
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We study the realizability of scale free-networks with a given degree sequence, showing that 
the fraction of realizable sequences undergoes two first-order transitions at the values and 2 of 
the power- law exponent. We substantiate this finding by analytical reasoning and by a numerical 
method, proposed here, based on extreme value arguments, which can be applied to any given 
degree distribution. Our results reveal a fundamental reason why large scale-free networks without 
constraints on minimum and maximum degree must be sparse. 
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Many complex systems can be modeled as networks, 

1. e., as a set of connections (edges) linking discrete ele- 
ments (nodes) A characteristic of a network that 
affects many physical properties is its degree distribution 
P{k), the probability of finding a node with k edges. 
Considerable attention has been paid to scale-free net- 
works, in which the degree distribution follows a power- 
law, P (k) ~ |4j-ll0|. In particular, scale-freeness has 
been shown to have important implications in the ther- 
modynamic limit. For studying the properties of scale- 
free networks, several generative models have been pro- 
posed [H-Q. However, no models creating networks with 
7 < 2 have been found [Hj , and 7 < 2 is observed 
only in networks that are relatively small or in which the 
power-law behavior has some cutoff [9j. In this Letter, 
we explain the absence of large networks that exhibit a 
power-law with < 7 < 2 in the tail of the distribution. 
Specifically, we show that fundamental constraints exist 
that prevent the realization of any such network. 

It is well known that the mean degree of scale-free dis- 
tributions with exponents 7 less than 2 diverges in the 
thermodynamic limit, i.e., when the number of nodes 
TV — >• 00 [2]. Scale- free networks with 7 < 2 would 
therefore be called dense networks, whereas networks 
7 > 2 are sparse. While sparseness is a common prop- 
erty, which is regularly exploited in data storage and 
algorithms, also many examples of dense networks are 
known [13l-ll5j . It is thus reasonable to ask why there are 
no examples of dense scale- free networks. We answer this 
question by showing that dense networks with a power- 
law degree distribution must have 7 < 0. Calling such 
networks scale-free is at best dubious because they would 
not exhibit the characteristic properties commonly asso- 
ciated with scale-freeness for N — >• 00. 

The absence of dense scale-free networks is explained 
by a discontinuous transition in the realizability of such 
networks. Below, we show numerically, analytically, and 
by a hybrid method proposed here, that the probability of 
finding a scale free- network with a given 7 is for < 7 < 

2. We emphasize that these results are not contingent 



on a specific generative model, but arise directly from 
fundamental mathematical constraints. 

The generation of scale-free networks with a given de- 
gree distribution can be considered as a two-step proce- 
dure. First, one creates a number of nodes and assigns 
to each node a number of connection "stubs" drawn from 
the degree distribution. The realization of the degree dis- 
tribution that is thus created is called degree sequence. 
Second, one connects the stubs such that every stub on 
a given node links to a stub on a different node, without 
forming self- loops or double links. However, not every 
degree sequence can be realized in a network. Sequences 
that admit realizations as simple graphs are called graph- 
ical, and their realizability property is commonly referred 
to as graphicality [Hj. Graphicality fails trivially if the 
number of stubs is odd, as one needs two stubs to form 
every link, or if the degree of any node is equal to or 
greater than the number of nodes, as it would be impos- 
sible to connect all its stubs to different nodes. Below we 
do not consider sequences for which graphicality is such 
trivially violated, but note that further conditions must 
be met for a sequence to be graphical [la, LL7j . 

The main result used for testing the graphicality of a 
degree sequence is the Erdos-Gallai theorem, stated here 
as reformulated in [17] using recurrence relations: 

Theorem 1. Let V = {do, c?i, . . . , djsf-i} be a non- 
increasing degree sequence on N nodes. Define Xk = 
min {i : d{ < k + 1} and k* = min {i : X{ < i + 1}. Then, 

is even, and 



V is graphical if and only if X^q 1 ^ 



L k ^R k V0 ^ fc < N -1 



(1) 



where Lk and Rk are given by the recurrence relations 
L = d (2) 
Lu = Lk-i + dk (3) 
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This formulation of the theorem has the advantage over 
the traditional one [18| of allowing a very fast implemen- 



tation of a graphicality test [17 ]. 



Equivalently, graphicality can be tested by a recursive 
application of the Havel-Hakimi theorem [19, [io| : 

Theorem 2. A non-increasing degree sequence V = 
{do, di, . . . , djsf-i} is graphical if and only if the sequence 
V = {di — 1, d2 — 1, . . . , dd — 1, ... , d/v-i} is graphical. 

To investigate the dependence of the graphicality of 
scale- free networks on the power- law exponent 7, we per- 
formed extensive numerics, generating ensembles of se- 
quences of random power-law distributed integers with 
range between 1 and N — 1 and 7 between —2 and 4. We 
tested each sequence for graphicality by applying Th. [TJ 
and computed for each 7 the graphical fraction 

G 

where G is the total number of graphical sequences in 
the ensemble and E is the number of sequences in the 
ensemble with an even degree sum. The results, plotted 
in Fig. [TJ clearly show two graphicality transitions: For 
very large and very small exponents almost all sequences 
are graphical. However, at intermediate exponents there 
is a pronounced gap where almost no sequence is graph- 
ical. The transitions between the two phases become 
steeper and the transition points approach 7 = 0, and 
7 = 2 as the system size is increased. 

The dependence of g on sequence length strongly sug- 
gests that both transitions are first-order. To verify 
their character, we studied Binder's cumulants U4 = 
1 — (d 4 ) /(d 2 ) [2ll, [22|. For continuous transitions, the 



cumulants for different system sizes lie within a finite 
interval and cross at the critical point, whereas for first- 
order transitions the curves are flat, except for a diverg- 
ing negative minimum whose position converges to the 
transition point with increasing system size 23-25|. In 
the present system the cumulants confirm that the graph- 
icality transitions at 7 = and 7 = 2 are first order. 

To understand the origin of the transitions, we focus 
on the scaling of the largest degrees and of the number 
of lowest degree nodes in the sequences. Below, we show 
that the first two largest degrees are of order O (N) for 
7^2, while they grow sublinearly with N for 7 > 2. 
Also, the number of nodes with degree of order 0(1) in- 
creases linearly with N for 7 ^ and decreases like TV 7 
for 7 < 0. Then, the transitions can be understood as fol- 
lows: If we tried to construct a scale- free network with 7 
between and 2, following the Havel-Hakimi algorithm, 
O (N) nodes with unitary degree would be used to place 
the connections involving the first node, and then there 
would be no way to place all the needed edges involv- 
ing the node with the second largest degree. Conversely, 
when 7 < 0, all but a vanishingly small fraction of nodes 
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Figure 1: Graphicality transitions in scale- free networks. The 
plots of graphical fraction g vs. exponent 7 show transitions 
at 7 = and 7 = 2. Binder's cumulants, in the insets, identify 
the character of the transitions and the transition points. 



have a degree of order O (TV), and for N — ^ 00 all the 
nodes are able to form as many connections as needed. 

To see this, calculate the expected maximum degree of 
a scale-free sequence 



f v^ 1 

d = max < x : N > — > 1 



f-^ Hn-i 

k—x 



(6) 
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where H a ^ is the a th generalized harmonic number of 
exponent b 



t=i 



3 



When N » 1, Eq. E] becomes 



N 



-dk = 1 . 



JV-1,7 



(7) 



Because of the dependence of the behavior of the gener- 
alized harmonic number on the exponent, we solve this 
equation for different values of 7. 
Solving the integral for 7 > 1 gives 



TV 



(N-l) 



1-7 



(1 - 7)ifjV-l, 7 

Equation [HI for TV ^> 1 implies 

TV 



1 . 



(8) 



(7 - 1) H N -i i7 



Because of the upper bound of the degrees of a sequence 
at TV — 1, if 1 < 7 ^ 2, the value of the largest degree 
grows linearly with the number of nodes TV. 
For 7 = 1, the integral in Eq. gives 



log (TV - 1) - log (a) = 



H 



N-l 



TV 



where iJjv-i = Hn -1,1 is the (TV — l) th harmonic num- 
ber. To solve the above equation note that the right-hand 
side vanishes in the limit of large TV. This can be seen by 
an application of l'Hopital's rule, noticing that for 7 ^ 



A^_ l57 = 7[ C (7 + l) 



H 



iV-l,7+lJ 



and 



lim Hn t 



C(7) 



where ( is Riemann's zeta function. Then, the solution 
of the equation in the thermodynamic limit is x ~ TV. 
Next, for ^ 7 < 1, Eq. [3 yields Eq. [8j hence 
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As in the previous case, the right hand side vanishes for 
large TV, and the solution is that x ~ TV. 

Finally, for 7 < 0, from Eq. [8] one gets again Eq. [9] 
However, in this case the right-hand side grows as TV -7 . 
Since 7 is negative, one can rewrite Eq. [9] for large TV as 



(TV-1) 



1+I7I 



N h\ 



which implies again that x ~ TV. 

The same arguments can be applied to the scaling of 
the second largest degree, with identical results. Now, 
consider the number A of nodes with unitary degree. For 
large TV, A = N/H N - ln . Thus, when 7 ^ 0, A ~ TV, 
whereas, if 7 < 0, then A ~ TV 7 . 

Then, to formally check the transition mechanism, ex- 
plicitly write inequality [T] for k = 1. The left-hand-side 
consists of the sum of the largest and the second largest 
degrees, which can be obtained using the same argument 
as above. To compute the right hand side, first notice 
that fc* ^ 2. In fact, by definition it cannot be 0, as 
this would imply that the highest degree in the sequence 
would be 0. Moreover, in our case it cannot be 1, as 
this would imply that the second highest degree in the 
sequence would be 1, in contradiction with what demon- 
strated above. Also, by the definition of it follows 
that x\ — TV — A. Thus, applying Eq. [5j the right hand 
side is simply 2TV — 2 — A. Therefore, the inequality reads 
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TV 



+ (TV - 1) 
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< 2TV 
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(10) 



A numerical solution shows that for TV ^> 1 the above 
inequality is indeed satisfied only when 7 < or 7 > 2, 
confirming the transition mechanism. Notice, however, 
that when TV — >> 00 almost all the nodes are fully con- 
nected for 7 < 0, and thus it is not appropriate to refer 
to such networks as scale- free. 

One can also study the inequality in the presence of a 
cutoff in the distribution, by replacing every instance of 
the natural upper bound on the degrees, (TV — 1), with 
the cutoff value. Cutoffs have been observed in real- world 
networks [1, 0] , and are sometimes imposed for different 
purposes, such as making the degree-degree correlations 



uniform [26|, [27} . Notably, their effect is making the in- 
equality always satisfied, and the transitions disappear. 

The above treatment indicates that, by applying ex- 
treme value arguments, one can build a finite length se- 
quence S = {so, si, . . . , sjv-i} fc> r the purpose of study- 
ing the graphicality of infinite systems. A finite sequence 
maximizing the degrees of the nodes for a given degree 
distribution will best approximate the graphicality of an 
infinite sequence, especially since broken graphicality is 
always caused by an excess of stubs in some subset of 
nodes. Therefore, for a length TV, and any degree distri- 
bution P (d) , the elements of the sequence are given by 
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Figure 2: Graphically of the degree maximizing sequence 
(N = 10 6 ) given by Eq. [TT] for scale- free distributions vs. 
exponent 7. The graphically transitions points are correctly 
identified. 

the family of functional 

{ dM ^ 
s* : N ^2 P(d) ^ i + , (11) 

where dj^ is the largest allowed degree. In general, dj^ — 
N — 1, but the full generality of its value allows cutoffs 
to be accounted for. Increasing the number of nodes in 
the representative sequence will improve the accuracy in 
the determination of transition points, as it will better 
approximate an infinitely large system. 

We computed degree maximizing sequences for power- 
law distributions, and tested them for graphicality. The 
results, shown in Fig. [2j are consistent with the simu- 
lations and with the analytical treatment, showing once 
again transitions at 7 = and 7 = 2. 

In conclusion, we showed that the graphicality of 
power-law degree sequences undergoes two discontinu- 
ous transitions at the values and 2 of the exponent 
7. In the limit of a large number of nodes, no network 
with an unbounded power- law degree distribution with 
< 7 < 2 can exist. We emphasize that this result 
arises directly from mathematical constraints on the de- 
grees of the nodes, and is thus independent of the specific 
procedure used for generating the network. It explains 
why the scale- free networks commonly observed in nature 
have 7 > 2 or have a cutoff. Established procedures may 
yield < 7 < 2 when applied to data from a given finite 
network. However, when the network grows or more data 
is acquired either a cutoff must exist or 7 must increase 
above 2 (or decrease below 0). It is possible to gener- 
ate large and dense networks with a power-law degree 
distribution with 7 < 0, but these networks should not 
be denoted as scale-free as they do not exhibit the prop- 



erties that are commonly associated with scale- freeness. 
Any large scale- free network is thus sparse, either because 
7 > 2 or because of the presence of a cutoff. This insight 
is reassuring as it implies that also numerical methods 
which are often needed for analyzing scale free networks 
will continue to scale favorably with increasing network 
size. 

The authors gratefully acknowledge Zoltan Toroczkai, 
Hyunju Kim and Chiu-Fan Lee for fruitful discussions 
and helpful comments on the manuscript. KEB was sup- 
ported by NSF grant No. DMR-0908286. 



[1] R. Albert and A.-L. Barabasi, Rev. Mod. Phys. 74, 47 
(2002). 

[2] M. E. J. Newman, SIAM Review 45, 167 (2003). 

[3] S. Boccaletti et al. Phys. Rep. 424, 175 (2006). 

[4] G. Caldarelli, Scale-free networks - complex webs in na- 
ture and technology (Oxford University Press, Oxford, 
United Kingdom, 2007). 

[5] D. J. de Solla Price, Science 149, 510 (1965). 

[6] S. Redner, Eur. J. Phys. B 4, 131 (1998). 

[7] R. Albert, H. Jeong, and A.-L. Barabasi, Nature 401, 
130 (1999); H. Jeong et al. Nature 407, 651 (2000); H. 
Jeong et al. Nature 411, 41 (2001). 

[8] L. A. N. Amaral et al. Proc. Natl. Acad. Sci. USA 97, 
11149 (2000); F. Liljeros et al. Nature 411, 907 (2001). 

[9] M. E. J. Newman, Proc. Natl. Acad. Sci. USA 98, 404 
(2001). 

[10] A. Vazquez, R. Pastor- S at orr as, and A. Vespignani, 

Phys. Rev. E 65, 066130 (2002). 
[11] S. N. Dorogovtsev, J. F. F. Mendes, and A. N. Samukhin, 

Phys. Rev. Lett. 85, 4633 (2000). 
[12] P. L. Krapivsky, S. Redner, and F. Leyvraz, 

Phys. Rev. Lett. 85, 4629 (2000). 
[13] V. Spirin and L. A. Mirny, Proc. Natl. Acad. Sci. USA 

100, 12123 (2003). 
[14] A. H. Y. Ton et al. Science 303, 808 (2004). 
[15] P. Hagmann et al. PLoS Biology 6, 1479 (2008). 
[16] H. Kim et al. J. Phys. A - Math. Theor. 42, 392001 

(2009). 

[17] C. I. Del Genio et al. PLoS One 5, el0012 (2010). 
[18] P. Erdos and T. Gallai, Mat. Lapok 11, 477 (1960). 
[19] V. Havel, Casopis Pest Mat 80, 477 (1955). 
[20] S. L. Hakimi, J. Soc. Ind. Appl. Math. 10, 496 (1962). 
[21] K. Binder, Z. Phys. B - Cond. Mat. 43, 119 (1981). 
[22] K. Binder, Phys. Rev. Lett. 47, 693 (1981). 
[23] K. Binder and D. P. Landau, Phys. Rev. B 30, 1477 
(1984). 

[24] K. Vollmayr et al. Z. Phys. B 91, 113 (1993). 

[25] D. P. Landau and K. Binder, A guide to Monte Carlo 
simulations in statistical physics (Cambridge University 
Press, Cambridge, United Kingdom, 2000). 

[26] S. Mossa et al. Phys. Rev. Lett. 88, 138701 (2002). 

[27] M. Catanzaro, M. Boguna, and R. Pastor- Sat orr as, 
Phys. Rev. E 71, 027103 (2005). 



